Papers with positioning method
Towards Faithful Dialogues via Focus Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge-grounded models rely on elaborate data engineering or increasing the model’s parameters ignoring to track the tokens that significantly influence losses, which is decisive for the optimization direction of the model in each iteration. |
| Approach: | They propose a novel learning approach that adjusts the contribution of each token to the optimization direction by directly scaling the corresponding objective loss. |
| Outcome: | The proposed approach achieves the new state-of-the-art results and generates more reliable responses while maintaining training stability. |